HetRL: Efficient RL in Heterogeneous Environments

HetRL is proposed for efficient RL post-training in compute-heterogeneous environments. HetRL forms the RL infrastructure as a joint optimization problem and proposes 2 scheduling algorithms (near-optimal based, and integer lineaer programming based) for RL infra.